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PREFACE 

This report is the first in a series to be published at six- 
month intervals describing the literature of computer-assisted 
instruction (CAI) as it has been compiled by ENTELEK under contract 
Nonr-47 57(00) . This report covers approximately one hundred docu- 
ments abstracted prior to December 31, 1965. Obviously, the CAI 
literature is more extensive and it is hoped that subsequent reviews 
will be more nearly representative of the whole. 

The contents of the report are organized according to the key 
word organization of the ENTELEK CAI information exchange. Cita- 
tions given are the serial numbers assigned to documents in the 
ENTELEK system. 

The section of this report dealing with interface equipment was 
written by John M. Newton. Albert E. Hickey is responsible for the 
balance of the report. The authors are indebted to Drs. Glenn Bryan 
and James Regan of the Personnel and Training Branch, Office of 
Naval Research, who have constructively monitored the general develop- 
ment of the system from its inception. 
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I. APPLICATIONS 


A. SUBJECT MATTER 

Appendix A lists 41 references to CAI programs in mathe- 
matics and statistics, history, languages, science, economics, 
accounting, engineering, computer technology, reading, games, 
and industrial and military skills. These 41 citations, however , 
describe about 20 di stinct progra ms, few oi which are more tha n 
three study- hours in duration . 

Potential application of automated instruction. to other sub- 
jects is also discussed in the literature. For example, in an 
experiment on the discrimination learning of smoothness of machined 
metal surfaces, Mager and Clark (63-901) demonstrated the possi- 
bility of teaching non-objective responses, including judgements of 
social or nonsocial stimuli, value, and attitudes, 

B. OTHER APPLICATIONS 

Automated instructional systems have also been used for 
purposes other than instruction. Pines (65-502) reports that the 
Edison Responsive Environment has demonstrated therapeutic value 
for autistic children. 

The Control Systems Laboratory at the University of Illinois 
has investigated a textbook tester that will permit an ordinary text- 
book to be entered into the PLATO system and a complete record 
kept of the student's work studying it (64-1202). Analysis of students' 
use of the text will indicate necessary text revisions and these can be 
made and tried out immediately. 

Feurzeig (64-804) believes the Socratic System has potential 
value in areas othe r than teaching , e.g., planning, testing, inter- 
viewing, and monitoring. Stolurow (64-1101) has reported on an 
adaptive retrieval system for use with abstracts. Retrieval strategies 
adopted by the system are dependent on the user's response to ab- 
stracts . 
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II. SYSTEMS 


A. SYSTEMS ANALYSIS 

Systems analysis refers to the construction of models and 
procedures to optimize some function of the variables involved in 
the model. The function may be learning. 

Stolurow (65-702) believes a general cybernetic model of 
an instructional system has seven components: input (display to 
the learner), learner, output (learner response), performance 
standards, comparator (comparison of output with standard), library 
and feedback. He has outlined the variables associated with each 
component. 

SOCRATES is an operational model of the instructional 
process as seen by Stolurow (65-702, 64-901). The model is ideo- 
morphic in that it considers the learner's characteristics as assessed 
before instruction and is also adaptive during instruction. 

Mayer (64-902) views the trainee and instructor as operators 
within an information system and proposes a model for use in the 
application of human engineering principles and techniques to the 
design of instructional systems. 

Egbert and Cogswell (64-202) examine a plan for a Continuous 
Progress School (CPS) being developed at the Brigham Young Univer- 
sity Laboratory School and use the data for systems analysis and 
simulation to construct an explicit descriptive model of a future CPS. 

In another report (64-303) the same authors outline the use of systems 
analysis and computer simulation in investigating the effects of 
innovations and adjustments in school curricula. 

B. COMMON SYSTEM CHARACTERISTICS 

1. Time-Sharing 

To be economical, large computer-assisted instructional systems 
must service many students at once. Thus, time-sharing is an import- 
ant requirement. 
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"A computer-based teaching system has a number of student 
stations tied to one central, general purpose, high-speed computer. 

With such a time-sharing system, the decision-making and computa- 
tional power of the central processor can be harnessed to provide 
for sophisticated automatic teaching techniques (Braunfeld, 62-802). " 
Due to the speed of the computer, a given student is seldom conscious 
of the fact that other persons are being serviced by the system. 

Lochner (65-903) describes time- sharing in the Dartmouth 
College systeim. Equipment consists of a GE-235, a Datanet-30 Com- 
munications Controller, and a dual-access disc file. The D-30 is the 
master computer and schedules all nontrivial operations in the 235. 

In addition, the D-30 handles input/output from and to the teletypes, 
allocates and releases disc space, and analyses and responds to user 
commands. Lochner includes ideas on optimizing the use of a time- 
shared system. 

Feurzeig (64-60 1) sees time-sharing of the computer as the 
way to make the BBN Socratic System, with its extensive vocabulary 
and logic requirements, economically feasible. In other papers 
(64-804, 64-803) he describes the use of time-sharing in the Socratic 
System to evaluate "collaborative time-3haring . " An experiment was 
run in which six subjects, sitting at separate consoles, worked together 
on a problem. They did somewhat better through collaboration than 
each would likely have done individually. 

In 1963 the PLATO I system at the University of Illinois 
Coordinated Science Laboratory was replaced by PLATO II which 
was used to study problems of time - sharing . Now PLATO III, based 
on a CDC 1604, is capable of controlling 1000 student stations, although 
20 was set as an initial goal (64-1202). 

In a manual (64-001), IBM explains that, with proper equipment, 
the IBM 1401 or 1440 operating system used for computer-assisted 
instruction may be time -shared so that it can simultaneously teach up 
to five courses, using up to 12 typewriter stations. 

In Russia, the Radon complex at the Academy of Sciences of 
the Ukrane uses the general purpose UMShN computer with up to 25 
student terminals (64-201). Expansion of the time -sharing system 
will allow it to teach 120 to 150 students as many as four different 
subjects simultaneously. 
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An advanced application of time- sharing is planned in a coaxial 
community cable network that will connect 10,000 homes in Columbia 
City, Maryland, to a community digital computer (65-603). The system, 
which will enable the near simultaneous use of the computer by 5000 
people, is being designed by the Brooks Foundation in conjunction with 
the Maryland State Dept, of Education. 

2. Partial Answer Processing 

Preliminary data collected by Wodtke and his associates 
(65-902) indicate the importance of partial answer processing, by which 
the computer in a CAI system is instructed to ignore trivial errors and 
differences in student- response formats. Student controlled pauses in 
the instructional output of the system also seem important. The study 
was conducted at Pennsylvania State University using remote terminals 
of the IBM Yorktown system. The Socratic System also provides for 
partial answer proces sing through the use of a subroutine called CODEX. 

C. OPERATIONAL SYSTEMS 

In the past three or four years computer-assisted instruction 
systems have grown, more or less independently, in several labora- 
tories. These pioneering examples of CAI share some common features, 
such as time-sharing just described. Each also has unique features. 

In this section we list and describe several well-established systems. 

In the recent past, each of the following systems was restricted 
to the laboratory or campus on which it was generated. Recently, 
however, remote terminals for several of these systems have been 
installed at other laboratories and schools, sometimes at the opposite 
end of the country and even overseas. Thus, some systems can no 
longer be identified solely with a particular institution, except histori- 
cally or administratively, but are nationwide in extent. 

I . IBM Yorktown. 

An extensive system is based on the IBM Watson Research 
Laboratories at Yorktown, New York. This system was originated with 
an IBM 650 RAMAC with a disc file for 6 million digits and 0.8 secs, 
maximum access time (64-302). I/O capability was provided by 20 
Modified Inquiry Stations Type 833. In 1964 an IBM 1440 was sub- 
stituted for the 650 (65-902, 65-803, 64-001). 
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Students at Pennsylvania State and Florida State Universities 
now take courses transmitted from IBM's Yorktown complex (65-902). 
The course is presented at a modified electric typewriter and by 
random-access slide projector and tape recorder. 

In 1965 the IBM Yorktown system was linked by telephone wire 
to terminals at the Americana Hotel in Mew York City for the Ameri- 
can Management Association conference on edxicational technology. 

2. IB M Poughkeepsie 

A system similar to the I3M Yorktown system is based on an 
IBM 1440 at Poughkeepsie. Through remote terminals located at 
IBM offices in Philadelphia, Los Angeles, San Francisco and Wash- 
ington, D. C. , IBM customer engineers will receive training while on 
call at their offices (65-1002, 65-910, 65-803). 

3. University of Califor nia at I r vine (U CI) 

Under a joint research agreement with IBM, UCI will become 
a computer laboratory for investigating all the ways in which the com- 
puter can aid educational institutions (65-910). 

4 . Dartmouth Time -Sharing Sy s tem 

The Dartmouth system is presently more suited to the labora- 
tory type of instruction and handles jobs from 30 remote consoles. 
Equipment consists of a GE-235, a Datanet-30 Communications Con- 
troller, and a dual-access disc file. The D-30 is the master computer 
and schedules all non-trivial operations in the 235. The D-30 can 
communicate with the 235 or the dual-access file. In addition, the 
D-30 handles I/O from and to the teletypes, allocates and releases 
disc space and analyzes and responds to user commands. The 235 
is used for editing, compilation, program runs, and large block 
transfers from one area of the disc to another. Incoming problems 
share the 235 in short bursts of time on a rotating basis. 

When the system was first put into operation, only one 
algebraic compiler, BASIC, was available. Subsequent additions have 
included: TEACH, a system which allows an instructor to code BASIC 
programs to analyze the results of a student program while the student 1 
program is running; a fairly complete version of ALGOL 60; a machine 
language interpretive program called DIP; and a program maintenance 
system called EDIT. Lochner (65-903) covers the approach used to 
develop the system and response by users. 
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Berkeley (65-904) demonstrates the use of a remote console 
of the Dartmouth system situated in a mathematics classroom at 
Phillips Exeter Academy. The student-contrived programs for 
Tic Tac Toe and Roulette are in BASIC. 

5. CLASS 

The Computer-based Laboratory for Automated School System 
(CLASS), developed by the System Development Corporation, pro- 
vides instruction for up to 20 students under rhe control of a computer. 
In addition to a laboratory-type course in statistical inference, CLASS 
has been used for computer-based student counseling and field evalua- 
tion of an elementary Spanish course (65-402, 64-40 3). 

6 . System 47 3L 

System 47 3L is a command -control system operated by the 
U. S. Air Force. It includes an automated instructional subsystem 
which teaches AF console operators the query language to be used in 
communicating with main system (64-1203). 

7. Edison Responsive E nvironment 

The Edison Responsive Environment is a jam-proof electric 
typewriter, slide projector, and tape recorder, all connected to a 
self-contained logic network or computer. Currently the logic is not 
time -shared among students, although it may be in the future. The 
system is used primarily to teach pre-school children language arts 
(65-502). 

8. SAKI 

The best known of the machines developed in the UK by Gordon 
Pask is SAKI, which instructs the student in keyboard operation 
(65-10 3). Errors and response times were calculated by SAKI, com- 
pared with standard performance and fed back to the student. It was 
not a time-shared system. 

9. COBIS 

The Computer-Based Instructional System (COBIS), located 
at the Electronic System Division, Har.scom Air Force Base, Bedford, 
Mass. , is based on a DSC PPD- 1(65-30 1} . It has three principal 
features: (1) A light pencil is used as the medium of communication 
between the student and the computer. (2) The student indicates his 
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degree of certainty for each £.1. .or nati ve a ir.vi-iole choice array 

by adjusting the bars of light aor; to each answer on a CRT screen. 

(3) The computer consicers both the student’s answers and his 
degree of certainty when branching to remedial sequences or further 
steps. A special scoring system has been developed for this purpose. 

10. The Socraiic System 


In the Socratic System, developed by Bolt, Beranek and 
Newman, Inc. , around the DEC PDF- 1 computer, the teacher and 
student carry on a dialogue in depth (35-1001, 55-703, 65-302, 64-601, 
64-503). The computer states a problem, sets up conditions, asks 
questions, provides requested data, and answers questions, while 
observing the student's course of action in a task. Tne system has 
been applied to instruction in medical diagnosis and business decision 
making. 


SOCRATES 


SOCRATES is a time- shared system developed at the Training 
Research Laboratory of the University of Illinois. It is adaptive in 
three ways: (1) it learns about the student as io teaches him-, (2) it 
may make decisions about the effectiveness of the rules used to teach 
the student, and (3) it may make decisions about the criteria which 
are used for evaluating performance. 

The first SOCRATES student interface was put on-line in May 
1964. SOCRATES uses an IBM RAMAC external disc memory of 
2 million-digit capacity to supplement internal storage in an IBM 1620 
computer. The system may display any of 1500 frames of film to the 
student. An IBM. 1800 central computer and a Westinghouse sound box 
with 1000 stored one-sec. messages under computer control are on 
the way (65-701, 64-1101, 64-901, 64-602). 

3.2. PLATO III ' 

PLATO III is. the most recent in a series of systems devised 
by the Coordinated Science Laboratory at the University of Illinois. 

The central computer, a CDC' 1604, is connected to 20 student stations. 
The system uses an "electronic book and blackboard" video display 
system on which are superimposed both optical and CRT displays. The 
basic logic is tutorial and intrinsic. Tne PLATO compiler (CATO) is 
compatible with FORTRAN. 
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One capability of PLATO is Responsive Environment Pro- 
grammed laboratory (REPLA3) . A motion picture film is first 
shown using auxiliary equipment, then PLATO presents questions. 

Two brief programs have been used, one in physics (6th grade) and 
one in clinical methods for student nurses. A mathematics labora- 
tory called PROOF is also in use (64-1001, 64-401, 62-901, 62-802, 
62-702, 62-401). 

D. STUDENT INTERFACE EQUIPMENT 

The student interface is the junction, or communication link, 
between the student and the computer. L is an essential part of 
every CAI system. All systems in the literature reviewed are based 
upon two-way communication -- indeed, obtaining such an interaction 
or "conversation" between pupil and computer is a major reason for 
using computers as teaching devices. 

1. Display Techniques 

The problem is twofold: the computer's output must be displayed 
to the student and the student's output (responses) must be fed into the 
computer. A simple way to achieve both functions is to use an electric 
typewriter. This was the technique used in the early work in the IBM 
laboratories (64-302, 59-001), and is an alternative with the present 
IBM "Cour sewriter " system (65-803, 64-001). A typewriter (teletype) 
keyboard is also used for CAI with the Dartmouth Time-Sharing System 
(65-903), and with the Bolt Berauak and Newman "Socratic System" 
(65-1001, 64-601). 

While a typewriter has the advantage cf being an extremely 
flexible student response devise, its relatively slow speed limits its 
desirability as a display for the student. This limitation has been cir- 
cumvented by using a visual display with more rapid access to computer 
storage (e.g. a CRT), by using an auditory display, and by storing 
messages on film or tape and displaying these directly. In the latter 
case, the computer is used only to determine the location of the message; 
therefore requirements for storage capacity are greatly reduced. 

In IBM's "in house" researcli on their CAI system, CRT displays 
are used in an experimental employee training' course in two locations 
(Washington, D. C. and San Francisco), using the IBM 1050 input-output 
station (65-803) . Other training locations are vising the typewriter alone. 
This system uses telephone data lines for communication with a central 
computer, and has additional telephone lines for direct voice communica- 
tion with a numan instructor. The SOCRATES, system at the University 
of Illinois Training Research Laboratory is scheduled to have a CRT 
display in the near future (64-1101), and COB1S at the Air Force's De- 
cision , 65 - 301 ). 


o 
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PLATO, developed at the Coordinated Science Laboratory, 
University of Illinois, uses a unique combination of techniques 
(64-702, 64-401). Basically a video display, it is described as an 
"electronic book and blackboard. '• The "book" section allows indivi- 
dual microfilm slides to be displayed on the television screen, while 
the students' answers to questions, etc. are presented on the same 
screen in a manner analogous to writing on a blackboard. 

In its present configuration, SOCKATES employs a microfilm 
display (65-701, 65-101, 64-602). The central computer (an IBM 1620) 
controls a random access microfilm transport which displays one Of 
1500 instructional slides to the student. Microfilm slides are also 
used in the computer controlled economics games developed by the 
Board of Cooperative Educational Services of Northern Westchester 
County, New York (65-203). While the basic display is a typewriter 
(IBM 1050), a random access slide projector provides auxiliary inform- 
ation to the student. 

A quite different display was utilized by Teleregister for United 
Air Lines which makes collateral use of their "Instamatic" reservation 
system for training ticket agents (64-404). The instructional materials 
are presented in book form as muitipl e -choice questions. A regular 
reservation printout card is used to display answers. 

A combination typewriter-voice-slide projector display is used 
in the Edison Responsive Environment or "talking typewriter" (65-502). 
The typewriter both types and names letters and words when its keys 
are properly depressed. It also displays slides of letters or words as 
cues to the response of typing them. 

2. Response Techniques 

A typewriter keyboard is the basic response device in the IBM 
Coursewriter system (65-803), the Board of Cooperative Educational 
Services economics games (65-203), the' Dartmouth Time-Sharing 
System (65-903), and the Edison Responsive Environment (65-502). 

The PLATO system also uses a typewriter (teletype) keyboard, but In 
its various configurations may assign many different purposes to the 
keys (64-702, 62-401). Plastic caps are placed over special purpose 
keys to identify them. 
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Two sys use' keyboards otasr than chat of a standard type- 
writer. SOCkA .. - ..co fifteen buttons which may be asigned a variety 

of functions depending on the program -- e.g. setters, digits, yes-no, 
etc. (65-701, 65-101,. 64-602). The Telereglster-United Air Lines 
system uses the "Instamatic" agent-set keys with an overlay to rexdentify 
them for training (64-404). 

The student responses to CCBfS are made with a light pencil 
(65-501, 65-301). A bar of light is displayed next to each multiple- 
choice answer on a CRT. These bars represent the probability of 
correctness of each answer, and the student indicates his degree, of 
certainty for each answer by adjusting . A e length of the bars with his 
light pencil. Both the answer and the- cegree of certainty are considered 
by the computer when branching or advancing to the next level. 

Two publications are available which consider general interlace 
problems. The first, by Randa of MIT (62-201), is concerned with 
basic hardware. The second, by G.ater, Ramage and Lipson (o5-x204), 
deals with more specific instructional problems and considers the choice 
of equipment for different subject matter, for special education, and 
for research. 
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T-'l. LANGUAGES 

CAI languages can be divided into programmer-oriented and 
user- oriented languages. The users in turn fall into two classes: 
teachers and students. Teacher-oriented languages, such as 
COURSEWRITER, are the medium by which tue instructor tells the 
computer what assertions to make tc) the student, especially as a 
function of the student's previous resiponse(s) . A student language 
is the medium by which the student interacts with the computer. 

When the student is to use the compv.ter as z. tool or laboratory to 
solve a problem or a sequence of problems, the student language may 
be a compiler (e.g. BASIC) or a problem-oriented or simulation 
language (e.g. SEPOL) . 

A. STUDENT LANGUAGES 

1. BASIC. A programmer-oriented algebraic compiler 

available for the Dartmouth time- snaring system 
(65-903). Has been usee by secondary school students 
to program games, "Tic-Tac-Toe" and "Roulette, " on 
the Dartmouth system (65-904). 

2. TEACH. A system which allows an instructor to analyze 

the results of a student's program while the student's 
program is running. Used in the Dartmouth time- sharing 
system (65-903). 

3. SIMIN (Simulated Statistical Inference Program). Used 

to teach inferential statistics at Michigan State Univer- 
sity; 66 types of computer outpuc are available to the 
student (64-002). 

4. Natural Language (e.g. English). Most query languages 

take the form of artificial, qua si. -English languages which 
bear slight resemblance to ordinary English, but are 
sufficiently simple syntactically and sufficiently mnemonic 
lexically that user can master them with less difficulty 
than more specialized languages. Keyser (63-902) and 
Raphael (64-604) outline linguistic theories which increase 
the possibility of the use of natural English as a query 
language in CAI systems. 
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5. Graphic Language. AiLiough :he ideal is generally held 
co be a natural language, e . g . English, Duggar et al 
(65-102, 63-1202) cite the potential advantages of 
graphical symbology and ~ogic flow clagrams over 
English as a language for teaching logic and decision 
tasks to students. 

B. TEACHER LANGUAGES 

1. CGUESEWRITER. Presented by IBM as an aid in writing 
and presenting instructional material through the IBM 
140 1 and 1410 computers and 1C 50 Data Communications 
System. Course preparation requires no special knowledge 

a computers. COURSE WRITER has a dozen basic in- 
structions and its use can be learned in one or two hours 
(64-001). CCURSEWRITER has been used to program 
statistics (64-302) and several other subjects. 

2. MENTOR. A teacher- oriented language and compiler for 

the Socratic System in which language .conventions have 
been chosen so as to make the intention of the control 
statements comprehensible 1 to the teacher as well as the 
programmer. Thus, tne teacher may "converse with the 
computer when drawing up his instructional program in 
much the same way that tae student talks with the ma chine 
during a lessen (64-804, 64-803)." 

3. CATO. The PLATO compiler is compatible with FORTRAN, 

facilitating its use by non-technical persons who wish tp 
prepare lessons for PLATO (64-100*). 

C. PROBLEM- ORIENTED STUDENT LANGUAGES 

1. STRESS (STructural Engineering Problem Solver). Used 

by the graduate class in structures in the MIT Civil 
Engineering Dept, to design .complete structures (64-301). 

2. COGO (Coordinated GeOmetry) . Another problem- 

oriented language used at MIT. Includes 70 special words 
including "point, " "distance," "locate," etc. (64-301). 

3. SEPOL (Soil Engineering PrOolem- Oriented Language). 

Used in MIT Civil Engineering Dept. (64-301). 
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D. COMPILERS 

1. ALGOL 60. A programmer -oriented compiler available 

on the Dartmouth time-sharing system (65-903). 

2. DIP. A machine-language interpretive program used on the 

Dartmouth time - harm, g system (65-903). 

3. EDIT. A pret ram maintenance' s /stem available on the 

Da rtm outh time - sha ring system (65-903). 


Approved For Release 2003/04/29 : CIA-RDP84-00780R001 300060035-6 



Approved For Release 2003/04/29 : CIA-RDP84-00780R001 300060035-6 


IV. INSTRUCTIONAL. THEORY 

Some of the systems described in Chapter II are the result of 
the systematic consideration by behavioral scientists of the facts and 
theories of learning and instruction. Such sy stems are "custom- 
made" for instruction. This is uaraci. ariy true of the tutorial systems. 

Other systems, particularly the laboratory systems, simply 
represent the application of the computer as a problem- solving tool 
to didactic problem-solving as zi technic ue 01 instruction. 

Y/hether guided by behavior theory or the seat of their pants, each 
decision by a system designer or a programmer contributing to the 
design or implementation of a system is a contribution to a miniature 
theory of instruction. The system diagrams, flow charts and programs 
of CAI are theory fragments, or "logics, " based on some assumptions 
about the learning process. 

At the same time, data collected in computer-directed learning 
exercises are being added to the store of information on the instruction 
and learning processes. In some systems, such as SOCRATES, a fair 
amount of time is scheduled for systematic computer -controlled studies 
of learning and instruction variables. In other systems, observations 
on learning effectiveness are informal and incidental to application. 

In reviewing the studies of learning and instruction related to 
CAI, we have separated the reports into three categories: ( 1) Experi- 
mental studies of learning, such as the learning of paired associates, 
which seem to have a direct application to CAI. (2) Analysis of tne 
instructional logics on which various systems are based. (3) Optimi- 
zation of learning by the design and evaluation of instructional sequences 
(programming) . 

A. STUDIES OF LEARNING 

1. Paired Associates Learning 

Dear et al (65-304) compared a 1 earning -optimization procedure 
derived from a stimulus - sampling motel and another simple presenta- 
tion strategy in training subjects inseveral paired-associates tasks. 

The "optimal" strategy was found to be no better than the second pro- 
cedure. It appeared some representation oi snort-term memory must 
be incorporated in the model. The experiments were conducted in tne 
SDC CLASS system. 
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Izawa and Estes (65-302) found that iie learning of pair-ed- 
associate items was affected to a r.a;or extent by the ratio of rein- 
forced (R) to test (T) trials and by their arrangement in various 
repetitive sequences. For example, overall the sequence RTRT. . . 
appears more nearly optimal than RRTRRT. ... A stimulus -fluctuation 
model provides a somewhat better account of the acquisition and re- 
tention phenomena than a one- element model. 

2. Learning net 

Using conventional programmed textbook formats, Reynolds, 

Glaser, and Abma (64-1101) found learning sets were formed by all 
learners using programmed instruction, regardless of individual 
differences. PSI research at the University of Illinois Training 
Research Laboratory includes an effort to establish whether a learn- 
ing pattern in programmed instruction is one of proactive inhibition 
or learning set (64-602). 

3. Inspection Behavior 

Rothkopf (63-10 3) proposes a model for learning from self- 
instruction programs consisting chiefly of written sentences. The 
model suggests that inspection behavior plays a critical role in the 
effectiveness of self-instruction programs . 

4. Computer Simulation of Human Learning and Problem-Solving 

Human learning and problem-solving processes have been studied 
by computer simulation (64-505). Evans (64-1103) has devised a com- 
puter program (in LISP) which solves by heuristic methods a wide 
variety of intelligence test problems of the geometric analogy type, 
viz: "Figure A is to Figure B as Figure C is to which of the following?" 

B. INSTRUCTIONAL LOGICS 

Conversational interaction as simulated on the computer can be 
classified in two major categories: tutorial and Socratic. In the 
tutorial model, information is asserted zo the student and he is required 
to respond to a question. There are three kinds of tutorial programs: 
linear, intrinsic, and adaptive. Following Skinr.er, in a linear pro- 
gram the pace of instruction is changed to fit the student, and stimuli 
to which the student responds iticorrecLv may be repeated. Other- 
wise the linear program treats all students alike. 
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-or 03 3 


\--cL — .• y 


of a sequence of multiple 


choice items, tne selection ui eacn assertion is oasec on the student's 
response to the previous stimulus, Thus, by o ranching , each student 
may take a Giiiereni pat. a r £ subject — mauie. 


The pro- 
gram is adaptive in pace and in cne amount of instruction each student 
receives . 


m an a dan. ive rate - . ' nrogr .. __ , .jin as.,- Jior. is based on an ex- 
tensive history of student responses tt the program. Stoiurow (65-702, 
65-701, 64-602) advocates an a daptive system in which each stimulus 
is based, not only on the student's responses to the program, out on nis 
pretutorial characteristics of aptitude and personality. 


.e calls this 


an ideomomhic system and lias illustrated in operational terms (64-901) 
the way in which different characteristics oi ..earners are used in ideo- 
m orpnic programming (implemented as a two- stage decision process). 


So much for the tutorial model. The second major interaction 
model is the Sccratic system. As described ay Feurzeig etai (65- i00 1 , 
65-703, 65-502, 64-601, 64-305), the Socrat: c system goes beyond the 
tutorial programs by allowing the student to make assertions or ask 
questions of the computer. The computer bases its response to a 
question or assertion on its history of the interaction to that point. 


In the Soc ratio system the student is to ( i) deduce relationships 
among elements of a solution, i.e. form concepts; (2) ask questions 
and make assertions and always obtain a meaningful response; and 

(3) use natural language. The computer control language should 

(4) employ conditional expressions taking into consideration the 
history of the learner's actions, and (5) the compiler should be eiiSy 
for the teacher to use (65-302). The Socratic system is also, there- 
fore, adaptive. 


Most of the systems described in "this retort fit into one of the 
foregoing categories, although one may overlap another. The basic 
logic in PLATO II is tutorial and intrinsic, but the student can control 
the presentation with special function keys including "reverse" which 
permits review of slides, "help," and "aha" which permits termina- 
tion of a "help" sequence (62-401). 
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PLATO III is a tutorial program like * PLATO II, but it provides • 
up to eight help or error correction sequences instead of one. 

•'■TO valuators ” can also be inserted. These compare student perform- 
ance with specified criteria and branch to; additional expository- 
materials until the criteria are ro.ee. The program is thus made more 
adaptive { 64-70?' . In a PLATO HI Inquiry Training Program a motion 
picture is firm t a own using auxiliary equiimen.. Tnen PJLATO pre- 
sents questions. The student may try eo answer, or request additional 
information (64-401). 

COURSE WRITER is also tutorial and intrinsic (64-001). An early 
realization of an adaptive logic in a teaching machine was brought off 
by Ps.sk in SAi\I (65-103). 

C. SIMULATION 

Not all CAI is as directive as a tutorial program, or even as the 
Somatic system. In some applications the computer creates a simu- 
lated environment and provides an opportunity for the student to inter- 
act with that environment, learning by trial anc error. 

T or example, the computer may simulate a laboratory in which the 
student is able to initiate the same operations he would in a real labora- 
tory. SDC has created a simulated laboratory for statistics (65-402, 
64-002). The MIT Dept, of Civil Engineering has developed structures 
and stress problems which undergraduate: and graduate students solve 
on the computer (64-301). In the MIT applications, the computer not 
only creates the simulated environment ,• but is used as a tool in the 
solution of the problem, in much the same way il will be used to solve 
a real engineering problem. 

IBM and the Board of Cooperative Educational Services (BOCES) 
in Northern Westchester County have ceveioped a simulated environ- 
ment for teaching economics to elementary school students (65-201, 
64-1202). The purpose of this simulation is to develop in the student 
(I) an understanding of the processes at work in a developing civiliza- 
tion, and (2) the ability to make decisions: regarding multifactor ed 
situations, taking account of several conflicting values or goals. The 
student assumes the role of a priest-king; • of a Sumerian city-state in 
3500 B.C. Through a remote typewriter terminal, the computer 
(IBM 7090) gives him economic conditions and asks for decisions (e.g. 
How much of this year’s grain harvest should be set aside for next 
year’s planting?). BOCES has a second simulation, the Sierre Leone 
Development Game, in development (65-203). 


Approved For Release 2003/04/29 : CIA-RDP84-00780R001 300060035-6 

20 



Approved For Release 2003/04/29 : CIA-RDP84-00780R001 300060035-6 


The So c ratio System also creates a simulated environment 
(65-1001, 64-804, 64-601), For example, for instruction in medical 
diagnosis , a medics i pat ient a .los' tm raci-iti.es are simulated. 
Inthe management exercise, i. ncin-j-s is simulated, unlike the 
j i T engineering exercises ur ... ^ .... - aconom-c games, tne Socratie 

s vs tern iticiuaes evaluation u me t .. . ..normauce m tne feecibacx, 
reducing tne trial -and -error cun,... oi me instruction, hhis 
feature is available in the rear environment mien an instructor is 

‘■'J IT 0 S GIlu <i 

in .nummary, CA1 programs may be arranged on a continuum 
emending from the highly directive programs . suca as COURSE* 
v. 1 H-Td R, at one end, to tne non- directive at the other, such as the 
IdlT civil, engineering problems. The Socra :ic System, the Sumerian 
Game, and SIIv-lN lie somewnere in between these two extremes. 
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'/. r'HOGR AIMING 

A. SEQUENCE VARIABLES 

In structuring a program, ev?r a linear program, sequence 
variables fall into at a east tares ci. .sues re atec to (1) Lie nature of 
the content, (2) the nature of th s in opens s, and (3) the presence or 
absence of reinforcement, f.'ne programmer must first decide in 
what order to present s ub c on cents to. te iearaec. Then ne must De- 
cide whether these will be presented as rules, examples, or both. 
Finally, he must determine me secutr oi reinforced and non- 
reinforced (test) items, including the repetition of reinforced items 
as review frames. Hickey and Newt or* (oh- 1)3) have discriminated 
between these variables in a study of t ie structure of the knowledge 
space and the relationship between a. multi -dimensional knowledge 
space ana the one -dimensional teaching sequence. 

In experimental studies of te ci.er.ce variables, some invest- 
igators have found differences in learning effectiveness, others have 
not. Stolurow and his colleagues { p 4-70 i) found no difference in 
learning effectiveness as a result of prior experience with three 
different components of a subsequently learned mathematics task. 

Nor did the order in which items appeared in a program seem to make 
a difference in learning when one sequence is considered orderly and 
the other random. Newton ana Hickey (64-103) report some effects, 
however. Using 12 versions of a 59-frarne program teaching a concept 
in economics, they varied the order and position of subconcepts and 
the direction of the program with respect to definitions. The sequence 
variables did not affect error rate, but sdme did affect time to com- 
plete the program and achievement. 

Sheridan and Mayer (65-305, 63-1202) and Bio-Dynamics, Inc., 
(65-403) describe a phylogenic strategy for. sequencing the content of a 
program that teaches the function anc structure of a system. Follow- 
ing the phylogenic sequence, the trainee behaves as an inventor, 
causing the subject system to proceed in its development through the 
various stages, or "phyla , " in its evolution, either hypothetical Or 
real . 

Cement sequence was ir.vee tire. led by Dear et al (65-304) in 
■-aired a cue dates learning experiments . One optimization theory for 
the presentation of stimulus it. ms was based on a stimulus -sampling 
•model of a learning experiment. However, this strategy was not 
found superior to another simple presentation strategy when the two 
were compared experimentally. It appeared seme representation of 
short-term memory must be incorporated in the model. 
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1/cixl on tiic* tonic gi conteiu 3 oiciurow (o4-G0Z) 

thought it likely that giver, or eg r a. Timed instruction sequences gener- 
ate learning patterns corresponding to t mditionai concepts of learning 
theory. In one study he sought to determine whether an. undesirable 
learning pattern generated by a program was one of proactive inhibition 
or learning set. 

In a study of repetition and review in programmed instruction, 
Reynolds et ai (64- 1204} found that repetition above the usual level in 
a. linear program is of no benefit; but that spaced review is potentially 
beneficial . 

Two of the principal elements in programmed instruction 
sequence are reinforced (Id) trials or frames, and non- reinforced or 
test (?) trials. Izawa and Zstes (6 5-303' studied the optimal sequenc- 
ing of R and T trials in teaching "laired associates . The course of 
learning was affected by the ratio of It's to T''s and by their arrange- 
ment in repetitive sequences. Overall the sequence RTRT. . . appears 
to be most nearly optimal. They conduce that a stimulus -fluctuation 
model gives a better account of acquisition and retention phenomena 

‘-ir.cn. iA 2. OixG ” vhi ’GiT* di *3. i. iHOG cl « 

Hershberger (65-2,05) compared three intervals of delay be- 
tween the initial stimulus presentation and subsequent testing. In the 
first sequence, S reread the stimulus item before the test frame; in 
the second, after the test frame; and in the third only the correct ans- 
wer was exposed after S responded. There was an effect on errors in 
the program, but not on achievement. In any case, however, self- 
testing was superior to no self-testing;. 

1. DECISION- STRUCTURE 

Instructional Alternatives 

(Linear programs give all students the same instructional mat- 
erial. To accommodate individual differences, intrinsic, branching 
or adaptive programs may make available alternative materials, 
basing the selection of material on the student's most recent response 
or on a more extensive response history. For example, to instruct 
w waters of an Air Force information re trieval system in the query 
language use a in the system, Ciapp 3’. &1 (o4-I2C3) used a computer- 
directed program that followed a modifier "main trunk" branching 
logic. Tne "main trunk" was the linear nregravr. including rjretest, 
instructional sequence, and oosum. u 
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The difference between alternative stimulus materials may. 
simply be in the amount of cueing or prompting, the amount of in- 
formation in frames {step size; » repetition oi regular ira»aes, aE N 
presentation of special remedial frames. GUaer and his associates 
2) did not demonstrate an increase in learning efficiency for 
i r st two methods over a straight 1 .near program. A' re s s and 
mer , 55 - 901 ) also varied the amount of. prompting in a program 
" >;C v.t £ single fined mice, nanaxg the amount of prompting 

;;ive as subdividing tne pcpuitucn into groups homo- 


/ C A •’ A r 
i \J“X - ’d U 


UpUi6>-i-.WU i**tu £ . 

psnsous with respect to their pacing requirements. Stolurow et fl 

o 

7 A ? \ 


V/3.S nO'C ci.S Gj 

g - * ' 

(54-70 I) found that, although 3 spent 40 s s time on a large- seep pro- 
gram, there was no significant difference between periormance <?n 

..errns of achievement. 4 




jZe'O 


:ograms in 


gi re me 

He die net find a significant ' difference among the three amounts wdtn 
resoect to time to complete the program or achievement. » 


;■ programmed texts , Kaufman ico - i. 02 ) variea the aijipunt 
material available to tue- -student in an intrinsic program. 


tcision hiOgic 


intrinsic and adaptive programs base 


the selection of alter- 
native material on the student's most, recent response, or on a more 
extensive response history. Several logics tor the selection of mat- 
erials at each step in a program have been, proposed, m a computer- 
assisted study of speed reading, StroJ.o (64-504) cased the choice of 
instructional material on a statistical evaluation of the student s_.Oi.ai 
behavior in comparison with other sticsn.s ‘ total behaviors , the 
statistics changing as new students took the course. * 

Shuford (65-501) and Baker (bfc-301) have described a decision 
structure by which the computer considers both the student 1 s answers 
ctxi<i "iiis Ci^grge of c cites, livcy wiici* QTsiiC-tiing to Tsmeoicil sgc^uotic^s or 
further starts . A special scoring -system has been developed for chi s 
rurrose. No "errors" are made by iii-e- student. He progresses 
through levels of certainty and the computer always acts in the 
direction of raising his certainty. 


u. 


FRAME CONSTRUCTION 


I,o affective verbal terms undermine the effect of formal, 
or quantitative terms that appear in programmed instruction 
1 Erase (55-906) studied tniu question in the learning of; 

He found that :-.r. judging the validity of . .syllogisms, in 
setive terms wore hipniy inconsistent with the lormai 
terms, tue be at first made snap judgements mat were incorrect, out 
later were more deliberate, n moo 4 rate levei ©a. me ompati Oility . 
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escribe the development 
to .iron to train operators 
Impuasis is on the training 
the, draw chart and pro- . 


Sv/ets and Eeurzaig (65-..00_) report that 13 G hours were required 
for a physician and computer programme!!' to prepare the medical case 
used to demonstrate the application of tha Socru.ic System to instruction 
in medical diagnosis. An additional 30 hours of computer programming 
and clerical transposition were needed, pros several hours for editing 
the English prose. The student's vocabulary consists of 40 questions 
and 35 declarative statements. 


Elans {65-909) believes one hour of instruction per week, or- 
one week per year, is a reasonable production standard for the develop- 
ment of programmed instruction materials . He c cnciudes th3.tj unless 
programming itself is automated, it will ioften be necessary to resort 
to conventional methods of instruction, he describes a seven-step pro- 
cedure he has followed for gradually automating instruction which he 
believes can save substantial amounts of -programming effort. 


Stclurow describes the use r.f SCKIn 

OX pi' ol"l 0 r 3. cl 2X£ i 0 3 r XII XI Xf TXi 3 X O X* X 3. X 0 ^ r / U - 
3 dut OX CGC.G0 ior 1 XX 0 XXTX 1 C xx. crx X X* 0 XXX G 3 \ /XIX C C. 

from a ccxicexxt *s history of fraxrxoa. which 

r- 0 a / f /. _ X n. T>\ 
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f Ef» to develop a technology 

XX kj T-*4T O O O C.X1 XT 0 XS D3. o 6Q On 

.In.’ the computer to juuge , 
'.meat are relevant for ms 


Approved For Release 2003/04/29 : CIA-RDP84-00780R001 300060035-6 



Approved For Release 2003/04/29 : CIA-RDP84-00780R001 300060035-6 




used as a basis for accepting i 

20 related this question to J 

a large number of hypothjeees . ; 

; axirained. Wide variations . J 
ia j vers observed in terms of . j 
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VI. EVALUATION 


The ultimate criterion for automated instruction is student 
achievement per unit time and cost, but there are many intermediate 
or related criteria, such as error rate, reaction time, data rate 
requirement placed on the system, student reaction, etc. Eight per- 
formance criteria are discussed in connection with the evaluation of 
PLATO II (62-702). 

Several investigators have compared the learning effective- 
ness of CAI and more conventional instruction. At the University of 
Illinois, nine students in an introductory course in digital computers 
took three lessons via PLATO II. Their examination grades parel- 
leled those of the rest of the class and they were enthusiastic about 
CAI (62-702). 

Grubb and Selfridge (64-302) have described a typical experi- 
mental design used to compare CAI performance with instruction via 
programmed text or lecture. The three performance criteria were 
mean instruction time, mean review time, and average achievement 
score. The course was the first half of a one-semester course in 
psychological statistics. Students under CAI covered the material in 
5.3 hrs. compared with 49 hr s. for the lecture mode and 12 . 2 hr s . 
for the programmed text. The average achievement score in the CAI 
mode was 94. 3 compared with 58.4 in the lecture mode. 

Student reactions to CAI were reported by Wodtke and his 
associates (65-902) who found that some students, especially low 
achievers, considered the CAI presentation oh a remote terminal of 
the IBM Yorktown system too rapid. They suggest student-controlled 
pauses. 
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VII. ADMINISTRATION 


Based on PLATO system experience, Stolurow (64-402) 
believes CAI may be made available for as little as 10 cents per 
student hour. 

Grubb (65-906) points to the economic advantage of assign- 
ing two students instead of one to each CAI terminal. He investigated 
the pairing of students in a CAI course in statistics. His results 
indicate that students paired on the basis of their College Entrance 
Examination Board verbal scores will do as well on the final examin- 
ation as students who study individually at the CAI terminals. 
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APPENDIX A 
CAI Subject Matter 


Subject 

Call No. 

Serial No 

Mathematics and Statistics 

Algebra, UICSM 

222/F897 

64-204 

Arithmetic, binary 

101/R234 

59-001 

Mathematics: Algebraic proof 

424/C778D 

64-1001 


424/C778C 

64-702 

Number squaring and cubing 

730/M266 

65-910 

Statistics 

730/M266 

65-910 


730/G885 

65-906 


644/G885 

64-302 

Statistics, inferential 

022/F948 

64-002 


116/C324 

65-402 

History 

History, American 

730/M266 

65-910 

Languages 

English 

730/M266 

65-910 

Logic: Syllogisms 

400/F841 

65-908 

Spanish 

116/C324 

65-402 

Science 

Medical diagnosis 

435/F426 

64-601 


434/S975 

65-1001 


433/F426 

64-804 

Physics: Bi-metal strip expt. 

424/C778D 

64-1001 


424/C778C 

64-702 

Science, elementary 

444/W769 

65-202 

Economics 

Economics 

448/M739 

65-201 


424/C778 

64-1202 

Business and Accounting 

Accounting 

430/F426 

64-503 

Engineering 

Structures 

746/M414 

64-301 
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Subject Call No. 

Computer Technology 

Computer approaches to 
engineering problems 
Computer programming (47 3L) 

Computer use 
Computers, digital 

Games 

Bridge 
Roulette 
Tic-Tac-Roe 

Reading and Spelling 

Reading 730/M266 

640/P651 

411/S919 

Spelling 730/M266 


730/M266 

731/B512 

731/B512 


746/M414 

644/C589 

644/M468 

424/C778A 


Skills 

Keyboard operation 

Metal surfaces, smoothness of 

Nonverbal sounds 

Nursing, clinical methods in 

Task logic 

Typing 


620 /E9 7 
420/M191 
328/S97 5 
424/C778B 
1 18/S552 
640/P651 



Serial No. 


64-301 

64- 1203 

65- 801 
62-702 


65-910 

65-904 

65-904 


65-910 

65-502 

64- 504 

65- 910 


65-103 

63- 901 
62-601 

64- 401 
63-1202 

65- 502 
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APPENDIX B 
INSTITUTIONS WITH CAI 


Institution 


System, 


Stanford Univ. (Stan.) 

System Development Corp. (SDC) 

Carnegie Inst, of Technology 
Electronic Systems Div. , Air Force (ESD) 

Bolt, Beranek and Newman (BBN) 

Univ. of Illinois, Training Research Lab (TRL) 

Univ. of Illinois, Coordinated Science Lab (CSL) 

Mass. Inst, of Tech. , Civil Eng 'g. Dept. (MIT/CE) 
Mass. Inst, of Tech. , Operations Rsch. Grp. (MIT/OR) 
Mass. Inst, of Tech. , Project MAC (MIT/MAC) 

Mass. Inst, of Tech., (MIT/ESL) 

IBM Watson Rsch. Lab. (IBM/York.) 

IBM Poughkeepsie 

IBM Advanced Systems Div, (IBM/Los Gatos) 

Univ. of Pittsburgh, Learning Research and 
Development Center (Pitts /LRDC) 

United Air Lines (UAL) 

Brooks Foundation 
Bell Tel. Labs (BTL) 

Penn. State Univ. (PSU) 

Florida State Univ. (FSU) 

Harvard Univ. Computation Center (Harv.) 

Univ. Calif. , Santa Barbara (UCSB) 

Univ. Calif. , Los Angeles (UCLA) 

Univ. Calif. , Irvine (UCI) 

Univ. of Omaha (UO) 

McG raw -Edison 

Board of Coop. Educational Services (BOCES) of 
North Westchester County 


Stanford I & II 
CLASS 

COBIS 

Socratic System 

SOCRATES 

PLATO 


MAC 

IBM Yorktown 
IBM Poughkeepsi 


Instamatic 


IBM Yorktown 
IBM Yorktown 
TACT 


ERE 
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APPENDIX C 
CENTRAL COMPUTERS 


1. GE-235 &r D-30. Central equipment in the Dartmouth system. 

The D-30 is the master computer and schedules all nontrivial 
operations in the 235. The D-30 can communicate with the 
235 or the dual access file and handles I/O from and to the 
teletypes, allocates and releases disc space and analyzes and 
responds to user commands. The 235 is used for editing, com- 
pilation, program runs, and large block transfers from one 
area of the disc to another. Incoming problems share the 235 
in short bursts of time on a rotating basis (65-903). 

2. IBM 1440. Central computer in the IBM system at the IBM 

Watson Labs, Yorktown, N. Y. Also connected to Penn State 
Univ. , Florida State Univ. (65-902, 65-803, 64-001). 

Central computer in the IBM time -shared system at Pough- 
keepsie, N.Y., with student stations in Philadelphia, Los 
Angeles, San Francisco, and Washington, D. C. (65-803). 

3. IBM 7094. Two 94's located in the Computation Center and 

Project MAC at MIT are connected to typewriters in Rm 1-150 
the Civil Engineering Dept. (64-301). 

4. IBM 1620. Rm 1-150 in the MIT Civil Engineering Dept, con- 

tains an IBM 1620 (360,000 bit memory plus 32,000,000 bit 
disc pack) (63-301). SOCRATES has been developed on a 1620 
with 2 million digit RAMAC disc memory at the Univ. of Illinois 
Training Research Lab. (64-602). 

5. IBM 650. Before changing over to the present 1410-1440, the 

IBM Yorktown system was based on an IBM 650 RAMAC with 
disc file for 6 million digits and 0.8 max. access time (64-302, 
59-001). 

6. IBM 1401 or 1410. The Air Force Electronic Systems Division 

used the System 473L computer (IBM 1401 or 1410) to teach 
console operators the query language used by the operators to 
retrieve information from the 473L system (64-1203). 
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7. IBM 7090 . The Board of Coop. Educational Services 
(BOCES) of Northern Westchester County used an 
IBM 7090 time-sharing system to present computer- 
based economics games to Bixth-grade. students 
(65-203, 65-202). 

8. DEC PDP- 1 . Central computer in the BBN Socratic 
System at Bolt Beranek and Newman (64-601, 62-601) 
and in the Stanford Univ. system (65-001). 

9. CPC 1604. The central computer for PLATO III (64-1202, 
64-1001, 64-401). 

10. ILLIAC. The central computer for PLATO I and II. 
(64-1202, 62-401). 

11. Bendix G-20 ■ Installed in Carnegie Institute of Tech- 
nology Computation Center for use as a teaching machine 
for students in mastering certain drill problems in math. , 
engineering, and physical sciences (61-701). 

12. UMShN . Central computer in the Radon complex at the 
Academy of Sciences of the Ukraine (64-201). 

13. U ral - 1 . Central computer at the Kiev Higher Radio- 
technical Engineering School (64-201). 
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